🕷️️ Job Radar • SCRAPING

freelancer.com 2026-04-29 🟢

🔹 Refactor existing Python scraping bots using Playwright and BeautifulSoup into a structured Technical Manifest (JSON)
👤 Client: 🇧🇪 GENT, Belgium Member since 2007-05-01
💰 Price: $168 Average bid
🚩 Problem: Ensure compatibility and maintainability of existing scraping tools with new project requirements.
📦 Existing: [Stack], [Format]

Specifications:

[Target] - Refactor existing Python scraping bots to ensure they meet the specified technical requirements.
[Method] - Utilize Playwright for web scraping, BeautifulSoup for HTML parsing, and SQL connections (MySQL or PostgreSQL) for data retrieval.
[UI/UX] - Not applicable.
[Stack] - Python, Playwright, BeautifulSoup, MySQL/PostgreSQL, JSON.
[Security] - Implement anti-bot techniques including user agent rotation, proxy rotation, headless detection bypass, time delay randomization, and session handling.
[Format] - Ensure all code is modular, extendable, and maintainable. Output structured as JSON.

Workflow:

Review existing scraping bots for compliance with Playwright and BeautifulSoup standards.
Integrate SQL connections to retrieve input data from MySQL or PostgreSQL databases.
Refactor scraping logic using Playwright for web scraping and BeautifulSoup for HTML parsing.
Implement anti-bot techniques as required.
Adapt code to fit new project's input (JSON) and output (JSON) structure.
Ensure all code is modular, extendable, and maintainable.